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The paper proposes a simple formalism for dealing with deterministic, non-deterministic and stochas- 
tic cellular automata in a unifying and composable manner. Armed with this formalism, we extend 
the notion of intrinsic simulation between deterministic cellular automata, to the non-deterministic 
and stochastic settings. We then provide explicit tools to prove or disprove the existence of such a 
simulation between two stochastic cellular automata, even though the intrinsic simulation relation 
is shown to be undecidable in dimension two and higher. The key result behind this is the carac- 
terization of equality of stochastic global maps by the existence of a coupling between the random 
sources. We then prove that there is a universal non-deterministic cellular automaton, but no uni- 
versal stochastic cellular automaton. Yet we provide stochastic cellular automata achieving optimal 
partial universality. 

1 Introduction 

Motivations. Cellular Automata (CA) are a key tool in simulating natural phenomena. This is because 
they constitute a privileged mathematical framework in which to cast the simulated phenomena, and 
they describe a massively parallel architecture in which to implement the simulator. Often however, the 
system that needs to be simulated is a noisy system. More embarrassingly even, it may happen that 
the system that is used as a simulator is again a noisy system. The latter is uncommon if one thinks of 
a classical computer as the simulator, but quite common for instance if one thinks of using a reduced 
model of a system as a simulator for that system. 

Fortunately when both the simulated system and the simulating system are noisy, it could happen that 
both effects cancel out, i.e. that the noise of the simulator is made to coincide with that of the simulated. 
In such a situation a model of noise is used to simulate another, and the simulation may even turn out to 
be. . . exact. This paper attempts to give a formal answer to the question: When can it be said that a noisy 
system is able to exactly simulate another? 

This precise question has become crucial in the field of quantum simulation. Indeed, there are many 
quantum phenomena which we need to simulate, and these in general are quite noisy. Moreover, only 
quantum computers are able simulate them efficiently, but in the current state of experimental physics 
these are also quite noisy. Could it be that noisy quantum computers may serve to simulate a noisy 
quantum systems? The same remark applies to Natural Computing in general. Still, the question is 
challenging enough in the classical setting. 

Challenges and results. The first problem that one comes across is that stochastic CA have only re- 
ceived little attention from the theoretical community. When they have been considered, only proba- 
bilistic CA (PCA) consisting in a probabilistic function uniformly applied to a configuration have been 
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studied ETl l8l l6l l3l [191 171. However [2] exhibits several examples (such as the Parity example which 
we use later) which cannot be realized as PCA, in spite of the fact that they require only local random 
correlation and hence fit naturally in the CA framework. Moreover [2] shows that the composition of 
two PCA is not always a PCA. The lack of composablity of a model is an obstacle for defining intrinsic 
simulation, because the notion must be defined up to grouping in space and in time. In [ 2 ] a composable 
model is suggested, but it lacks formalization. 

In this paper we propose a simple formalism to deal with general stochastic CA. The formalism relies on 
considering a CA F(c,s) fed, besides the current configuration c, with a new fresh independent uniform 
random configuration s at every time step. This allows any kind of local correlations and includes in 
particular all the examples of 0. As in turns out, the definition also captures deterministic and non- 
deterministic CA (non-deterministic CA are obtained by ignoring the probability distribution over the 
random configuration). More importantly, this formalism allows us to extend the notions of simulation 
developed for the deterministic setting flUm, to the non-deterministic and stochastic settings. The choice 
of making explicit the random source in the formalism has turned out to be crucial to tackle the second 
problem, as it allows a precise analysis of the influence of randomness, in terms of simulation power. 
Indeed the second problem that one comes across is that the question of whether two such stochastic CA 
are equal in terms of probability distributions is highly non-trivial. In particular, we show that testing if 
two stochastic CA define the same random map is undecidable in dimension 2 and higher (Theorem[T]). 
Still, we provide in section [4] an explicit tool (the coupling of the random sources of two stochastic CA) 
that allows to prove (or disprove) the equality of their probability distributions. More precisely, we show 
that the existence of such a coupling is strictly equivalent to the equality of the distribution of the random 
maps of two stochastic CA (Theorem[2]). 

The choice of making expicit the random source allows us to show some no-go results. Any stochastic 
CA may only simulate stochastic CA with a compatible random source (where compatibility is expressed 
as a simple arithmetic equation, Theorem [4]). It follows that there is no universal stochastic CA (Corol- 
lary^. Still, we show that there is a universal CA for the non-deterministic dynamics (Theorem[5]), and 
we are able to provide a universal stochastic CA for every class of compatible random source (Theo- 
rem [6]). 

Plan. Section [2] recalls the vital minimum about probability theory. Section [3] states our formalism. 
Section [4] gives tools to prove (or disprove) equality of stochastic global functions. Section [5] extends 
the notions of intrinsic simulations to the non-deterministic and stochastic settings. Section [6] provides 
the no-go results in the stochastic setting, the universality constructions. Section [7J concludes this article 
with a list of open questions. 

2 Standard Definitions 

Even if this article focuses mainly on one-dimensional CA for the sake of simplicity, it extends naturally 
to higher dimensions. 

For any finite set A we consider the symbolic space A z . For any cGA z and zGZwe denote by c z the 
value of c at point z. A z is endowed with the Cantor topology (infinite product of the discrete topology 
on each copy of A) which is compact and metric (see iTTTIl for details). A basis of this topology is given 
by cylinders which are actually clopen sets: given some finite word u and some position z, the cylinder 
[u] z is the set [u] z = {c G A z : Vx,0 ^ x < \u\ — l,c z+x = u x }. 

We denote by ^#(A Z ) the set of Borel probability measures on A 1 . By Caratheodory extension 
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theorem, Borel probability measures are characterized by their value on cylinders. Concretely, a measure 
is given by a function ji from cylinders to the real interval [0, 1] such that jU(A z ) = 1 and 

Vu G Q*,Vz G Z, n([u] z ) = £ H([ua] z ) = £ Jl(Mz-i) 

We denote by Va the uniform measure over A z (s.t. Va([«] z ) = uW)- We shall denote it as v when 
the underlying alphabet A is clear from the context. 

We endow the set ^#(A Z ) with the compact topology given by the following distance: 

D (ll\,ll2) = L«^o2~" •max u eA 2 "+ 1 |Mi([ M ]-n) "JUzC ["]-«) ■ See ifTTl for a review of works on cellular 
automata from the measure-theoretic point of view. 

3 Stochastic Cellular Automata 

Non-deterministic and stochastic cellular automata are captured by the same syntactical object given in 
the following definition. They differ only by the way we look at the associated global behavior. Moreover 
deterministic CA are a particular case of stochastic CA and can also be defined in the same formalism. 

3.1 The Syntactical Object 

Definition 1. A stochastic cellular automaton = (Q,R,V,V' ,/) consists in: 

• a finite set of states Q 

• a finite set R called the random symbols 

• two finite subsets ofZ: V = {v\ , . . . , v r } and V = {v\ , . . . , v' r ,}, called the neighborhoods; r and r' 
are the sizes of the neighborhoods and p = max ve yuy/ |v| is the radius of the neighborhoods. 

• a local transition function f : Q r x R — > Q 

A function c G is called a configuration; cj is called the state of the cell j in configuration c. A 
function s G R z is called a ^-configuration. 

In the particular case where V' = {0} (i.e., where each cell uses its own random symbol only), we 
say that srf is a plain probabilistic cellular automaton ( PlainPCAfor short). 

Definition 2 (Explicit Global Function). To this local description, we associate the explicit 
global function F : <2 Z x R z — > defined for any configuration c and R-configuration s by: 
F(c,s) z =/((c£+v 1 ,...,c z+Vj .),(j z+1 / i ,...,j z _|_ 1 / / )). Given a sequence (s') f of R-configurations and an ini- 
tial configuration c, we define the associated space-time diagram as the bi-infinite matrix ( c Q (>0ze g 
where c' G <2 Z is defined by c° = c and c t+l =F(c t ,s t ). We also define for any t 1 the t th iterate of the 
explicit global function F' : x (R Z ) — > by F°(c) = cfor all configuration c and 

F' + \c,s\...,s t+l ) = F(F'(c,s [ ,...,s ! ),s' +l ) 

so that c' = F^CjS 1 ,. . . ,s f ). 

In this paper, we adopt the convention that local functions are denoted by a lowercase letter (typically 
/) and explicit global functions by the corresponding capital letter (typically F). Moreover, we will often 
define CA through their explicit global function since details about neighborhoods often do not matter in 
this paper. 

The explicit global function capture all possible actions of the automaton on configurations. This 
function allows to derive three kinds of dynamics: deterministic, non-deterministic and stochastic. 
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3.2 Deterministic and Non-Deterministic Dynamics 

Deterministic. The deterministic global function S> F : Q z — > Q z of = (Q,R,V,V' ,/) is defined by 
3>f{c) = F(c,O z ) where is a distinguished element of R. srf is said to be deterministic if its local 
transition function / does not depend on its second argument (the random symbols). 

Non-Deterministic. The non-deterministic global function jVp : <2 Z —> &>(Q Z ) of srf is defined for 
any configuration c G <2 Z by J/p(c) = {F(c,s) : s G R 1 }. 

Dynamics. The deterministic dynamics of si is given by the sequence of iterates {S> F )t^o- Similarly 
the non-deterministic dynamics of is given by the iterates jVp : <2 Z — > ^(Q z ) defined by jVpic) = 
{c}and^+V) = U c ' e ^( c )^(c'). 

3.3 Stochastic Dynamics 

The stochastic point of view consists in taking the /^-component as a source of randomness. More 
precisely, the explicit global function F is fed at each time step with a random uniform and independent 
/^-configuration. This defines a stochastic process for which we are then interested in the distribution of 
states across space and time. By Caratheodory extension theorem, this distribution is fully determined 
by the probabilities of the events of the form "starting from c, the word u occurs at position z after t steps 
of the process". Formally, for t = 1, this event is the set: 

£ c , [u]z = {seR Z :F(c, S )e[u] z }. 

In order to evaluate the probability of this event, we use the locality of the explicit global func- 
tion F. The event "F(c,s) £ [u\" only depends of the cells of s from position a = z — p to position 

b = z + p + \u\ — l. Therefore, if / = {v G R h ~ a : F(c, [v] a ) C [u] z }, then <^ C) [ M ] Z = U vS /[v] a and hence 
<?c,[u] z is a measurable set of probability: Vr(S c ^jJ = Lvg/ v r([ v ]«) = l-^l/l-^l* " (recall that Vr is the 
uniform measure over R z ). 

More generally to any CA s/ we associate its stochastic global function J^p : Q z — > ^(Q z ) defined 
for any configuration c G Q* by: Vw G <2 Z , Vz G Z, 

(^f(c)) ([m] z ) = V R ((T Ci[m] J = the probability of event S c ^ z . 

Example. For instance, consider the stochastic function Parity that maps every configuration c over 
the alphabet {0, 1,#} to a random configuration in which every {0, l}-word of length £ delimited by two 
consecutive # in c is replaced by a random independent uniform word of length t with even parity. This 
cannot be realized by a PlainPCA. Still, one can realize the stochastic function Parity as a stochastic CA 
by means of a local transition function / of the above type, as follows. Given the configuration c and a 
uniform random {0, l}-configuration s, f(c-i,co,ci,s-i,so) is: # if co = #; else so if c-i = #; else s-i 
if c\ = #; and + so mod 2) otherwise. One can easily check that this local correlation ensures that 
every word delimited by two consecutive # is indeed mapped to a uniform independent random word of 
even parity. 
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Dynamics. As opposed to the deterministic and non-deterministic setting, defining an iterate of this 
map is a not so trivial task. There are two approaches: defining directly the measure after t steps or 
extending the map S^f to a map from ^#(<2 Z ) to itself. Both rely crucially on the continuity of F. In 
particular, we want to make sure that the definition of the measure after t steps matches t iterations of 
the one-step map, and hence, is independent of the explicit mechanics of F but depends only on the map 
J^f defined by F. 

The easiest one to present is the first approach. For any t ^ 1, the event S x c ^_ that the word u appears 
at position z at time t from configuration c consists in the set of all ?-uples of random configurations 
(j 1 ,. . . ,s') yieldings u at position z from c, i.e.: 

<?' cMz = {(s\...,s t )e(R z ) t :F t (c,s\...,s t )e[u] z } 

As before S f c y is a measurable set in * because it is a product of finite unions of cylinders by the 
locality of F. We therefore define y p : Q z — > ^(Q z ), the iterate of the stochastic global function, by: 

(y F (c))([u] z ) = M< j[M]z ) = the probability of event <, ^ 

where v> denotes the uniform measure on the product space (R z )' ■ For similar reasons as above, y F (c) 
is a well-defined probability measure. 

The following key technical fact ensures that two automata define the same distribution over time as 
soon as their one-step distributions match. 

Fact 1. Let and be two stochastic CA with the same set of states Q ( and possibility different random 
alphabet) and of explicit global functions F and G respectively. If S?f = ^g then for all t ^ 1 we have 

C/)t c/)t 

— ^G 

Proof. Consider a CA of stochastic global function F. Consider a word u and a position z. Let <j) : Q 1 — >• 
^(R z ) be function that associates to a configuration c the event & c ,[u] z - 0( c ) i s entirely determined by 
the states of the cells from positions a = z — p to& = z+ |w|+p inc (locality of F). Therefore is 
constant over every cylinder [v] a with v G Q h ~ a . If we distinguish some c v G [v\ a for every v G Q h ~ a , we 
obtain by definition of F' and continuity of F: 

veQ b - a 

Then, since sets [S t c [ v ] a ) ve Qb-a are pairwise disjoint (because F is deterministic and cylinders [v] a are 
pairwise disjoint), we have 

{y F +\ c )){[u] z ) = VR , +l {^ uV )= £ v R(+1 « i[v]8 x<r CviH J 

veQ b - a 
veQ b -" 

= £ (^W)([v]a)-(^(Cv))(Mz) 

veQ b -« 

The value of S' F (c) over cylinders can thus be expressed recursively as a function of a finite number of 
values Sp over a finite number of cylinders. It follows that if for some pair of CA srf and with explicit 
global functions F and G we have y F = <?G, then <¥" F = S^ G for all t. □ 
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In our setting one can recover the non-deterministic dynamics from the stochastic dynamics of a 
given stochastic CA. This heavily relies on the continuity of explicit global functions and compacity of 
symbolic spaces. 

Fact 2. Given two CA with same set of states and explicit global functions Fa and Fb, if ^f a = ^F B then 

Proof. Given some stochastic CA of explicit global function F, some configuration c and some cylinder 
[u] z we have 

jV f (c) n [u] z S cHt + {y F (c))([u] z ) > 

by definition of J/p and 5^p. Since <Ap(c) is a closed set (continuity of F) it is determined by the set 
of cylinders intersecting it (compacity of the space). Hence jVf(c) is determined by 5?p(c). The lemma 
follows. □ 

4 Equality of random maps: undecidability and explicit tools 

An undecidable task for dimension 2 and higher. In the classical deterministic case, it is easy to de- 
termine whether two CA have the same global function. Equivalently determining whether two stochas- 
tic CA, as syntactical objects, have the same explicit global functions F and G is easy. However, given 
two stochastic CA which have possibly different explicit global function F and G, it still happen that 
,yVf = jVq or S^f = S^g, and determining whether this is the case turns out to be a difficult problem. In 
fact, Theorem [T] states that these two decision problems are at least as difficult as the surjectivity problem 
of classical CA, which is undecidable in dimension 2 and higher ifTOl . 

Theorem 1. Let &n (resp. be the problem of deciding whether two given stochastic CA have 

the same non-deterministic ( resp. stochastic ) global function. The surjectivity problem of classical 
deterministic CA is reducible to both &n and 

Proof. Consider a classical CA F : Q 1, — > Q 1, and define u\p as the image by F of the uniform measure 
Mo on Q z : 

Mf(Mz) = v(F- 1 ([«] z )) 

It is well-known that F is surjective if and only if /Xp = v (this result is true in any dimension, the proof 
for dimension 1 is in (9| and follows from |[T2l for higher dimensions, but we recommend ifTTl for a 
modern exposition in any dimension). 

Now let us define the stochastic CA srf = (Q,Q,V,V',g) such that G(c,s) =F(s). With this defini- 
tion, srf is such that, for all c, 5^g(c) = \If- Hence, 5?g{c) is the uniform measure for any c if and only 
if F is surjective. We have also J^cip) = Q Z f° r ai l c if and only if G is surjective. The theorem follows 
since srf is recursively defined from F. □ 

Explicit tools for (dis)proving equality. Even if testing the equality of the non-deterministic or 
stochastic dynamics of two stochastic CA is undecidable for dimension 2 and higher, Theorem [2] states 
that equality, when it holds, can always be certified in terms of a stochastic coupling. Indeed the stochas- 
tic coupling, by matching their two source of randomness, serves as a witness of the equality of the 
stochastic CA. This provides us with a very useful technique, because the existence of such a coupling 
is easy to prove or disprove in many concrete examples. Again the result heavily relies on the continuity 
of the explicit global function F. 

Let us first recall the standard notion of coupling. 
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Definition 3. Let ii\ G ^K(Qf) and /I2 £ (fif )■ ^ coupling of \L\ and 112 is a mea- 
sure 7 G ^#(<2i X fif) smc/i that for any measurable sets S\ and $2, x 2f ) = Ml(^l) 

r(ef x^ 2 ) = /x 2 (<r 2 ). 

Concretely, a coupling couples two measures so that each is recovered when the other is ignored. 
The motivation in defining a coupling is to bound the two distributions in order to prove that they induce 
the same kind of behavior: for instance, one can easily couple the two uniform measures over {1,2} and 
{1,2,3,4} so that with probability 1 , both numbers will have the same parity (7 gives a probability 1/4 
to each pair (1, 1), (2,2), (1,3) and (2,4) and to the others). This demonstrates that the parity function 
is identically distributed in both cases. 

Theorem[2]states that the dynamics of two stochastic CA are identical if and only if their is a coupling 
of their random configurations so that their stochastic global functions become almost surely identical. 
This is one of our main results. 

Definition 4. Two stochastic cellular automata, stf\ = (Q,Ri,Vi,V{,fi) and £^2 = (£2,^2, V2, V^jfc), with 
the same set of states Q are coupled on configuration c G Q 1, by a measure 7 G ^(Rf x /?|) ;/ 

1. y is a coupling of the uniform measures on Rf and R\; 

2. 7({(ji,j 2 ) £ Rf X R 2 '■ Fi(c,si) = F 2 (c,j 2 )}) = 1, i-e. F\ and F2 produce almost surely the same 
image when fed with the y-coupled random sources. 

Note that the set of pairs (51,52) defined above is measurable because it is closed (F\ and F2 are 
continuous). 

Theorem 2. Two stochastic CA with the same set of states have the same stochastic global function if 
and only if on each configuration c, they are coupled by some measure y c (which depends on c). 

Outline of the proof. We fix a configuration c. By continuity of the explicit global functions, we construct 
a sequence of partial couplings ()£) matching the random configurations of finite support of radius n. 
We then extract the coupling y c from (y£) by compacity of J%{Rr^ x 7?f ). 

Proof. Details. First, if sf\ = {Q,Ri,V\,V[,f\) and £^2 = {Q, Ri,V2, V^fz) are coupled by y c on config- 
uration c £ Q z , consider for any cylinder [u] z the sets 

£i = {s€S$ :F!(c,s)€[u] z } 
£ 2 = {s€B$:F2(c,s)€[u] z } 
X = {(s u S2)eRfxRf:F l (c,s l )=F 2 {c,S2)} 

Then, by the property of the coupling by y c , we have 

(^ 1 (c))(K0 = v 1 ( ( f 1 ) = 7c (A x*f) 

where Vi is the uniform measure on Rf. But y c (S \ xfff) = Yc{{&\ X/?f ) Hi) since y c {X) = 1. Sym- 
metrically we have 

{y F2 (c))([u] z ) = y c {(Rfx^ 2 )nX). 

But, by definition of sets g\, S 2 and X, we have Rf X (f 2 nX = S'i xR% DX. We conclude that y Fl = 
yp 2 . For the other direction of the theorem, suppose S fi F i = S^f 2 and fix some configuration c. We denote 
by jU the measure ^i(c) = ^? 2 (c). Without loss of generality we can suppose that s$\ and £^2 have 
same raidii p: pi = P2 = p. We construct a sequence (7") of measures from which we can extract a limit 
point (by compacity of the space of measures) which is a valid coupling of si\ and srf 2 on configuration 
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c. To simplify the proof we focus on centered cylinders: for any word w of odd length, we denote by 
[w] = [w] Zw where z w = — ^-j^- Let's fix n. For any word u G Q 2n+1 we define: 

S 1 u = {s€F$:F 1 (c,s)€[u]} 
S 2 u = {seRt.F 2 (c,s)e[u}} 

F\ and F 2 being of radius p we can write S' u as a finite union of centered cylinders of length 2(n + p) + 1 : 

4 = U M 

where P' u C /j 2 ("+'') +1 - Define the following partition of the real interval [0, 1) by: 

rank(v) rank(v) + l 



m = 



where rank(v) G {0, . . .,#P' U — 1} is the rank of v in some arbitrarily chosen total ordering of P l u (the 
lexicographical order for instance). Since the sets , 
all words of Q 2n+1 , we have for any v G /? 2(n+p ) +1 : 



lexicographical order for instance). Since the sets P l u form a partition of R 2 ( n+p ) +i when u ranges over 



(recall that V; stands for the uniform measure over Rf ). Now, for every v 1 G R 2( - n+p)+l and 
v G R 2 , we construct y" as: 

' \ll (v 1 ) n 7 H 2 (v 2 ) I • ll Q ( [m] ) if 3u s.t. v 1 ' G P u for both / = 1 , 2 



otherwise. 

1 r- r>2m+l 



Furthermore, if 0,- is a distinguished element of /?,-, we extend the definition of y* 1 to any pair v G R l 
and v 2 G A';'" : with m^n + p by: 



f([v l ],[v 2 }) 



f([w l ], [w 2 ]) if V = 0f- n - p w i 0f-"- p for i = 1,2 
else. 



By a-additivity y is thus defined on any cylinder and by extension theorem is a well-defined measure. 
Now by construction, we have for any v 1 G R 2 ( n+ P) +l ; 

f([v 1 ],Af) = |/ i !(v 1 )|- Aie (M) 

for some u such that v 1 G P\. Hence, "/"([v 1 ], /?f ) = v^fv 1 ]). By a-additivity of y" and ji, this equality 
holds for any v 1 G R 2m+l with m^n + p. Symmetrically we have y"(Rf, [v 2 ]) = jU[/ 2 ([v 2 ]) for any v 1 G 
R 2m+1 . Moreover, by definition, ^([v 1 ], [v 2 ]) = if there is no u such that v l G P l u for i = 1,2. We deduce 
that the set: 

X n = [J S U XS U 

ueQ 2n+1 

has measure 1. More precisely, since X n+ \ C X n , for any m^n, y"(X m ) = 1. 

To conclude the proof, let 7 be any limit point of the sequence (/%. By the definition of the distance on 
the space of measures, we have: 



216 



Intrinsic Simulations between Stochastic Cellular Automata 



1 . Vm, Vw G Rf" +l , y( [w] , /?f ) = Vi ( [w] ) and symmetrically for the R2 component, hence 7 is a cou- 
pling of uniform measure on Rf and R\ ; 

2. Vn,y(X„) = 1 hence 7(n„X„) = 1 where 

fl^„=X = {(Ji^2)e J Rf xflf ;F l (c, Sl )=F 2 (c,S2)} 

n 

We deduce that stf\ and ^ are coupled on c by measure 7. 

□ 

Notice that the proof of this theorem is non-constructive (recall that equality of stochastic global 
maps is undecidable in dimension 2 and higher). Moreover, it is easy to get convinced on a simple 
example that the coupling must depend on the configuration. Consider the two following automata with 
states Q = R = {0, 1} and neighborhoods V = V' = {0}: srf with explicit global function F(c,s) = 
s and 3§ with explicit global function G(c',s') = d + s' mod 2. Clearly, both and S$ define the 
same blank noise CA and the coupling proving this fact is defined for all z £ Z and all a, b G {0, 1} by 
7 c ([a] z , [b] z ) = 1/2 if and only if a = b + c z mod 2, and = otherwise. This coupling demonstrates 
indeed that y c ({{s,J) : F(c,s) = G(c,/)}) = 1 yielding that the dynamics are identical; but note that 7. 
must depend on c. 

5 Intrinsic Simulations 

The purpose of this section is to give a precise meaning to the sentence is able to simulate or 
equivalently contains the behavior of . 

Our approach follows a series of works on simulations between classical deterministic CA lTT8l [T3l 
|20j|4l|5l. We are going to define simulation pre-orders on stochastic CA which extend the simulation 
pre-orders defined over classical deterministic CA in Q. Precisely, we want the new pre-order to be ex- 
actly the classical pre-order when restricted to deterministic CA. For general background and motivation 
behind this simulation pre-order approach we refer to El HI. Intrinsic simulation has also been brought 
to deterministic quantum CA in HI. 

In each case (the deterministic, the non-deterministic, and the stochastic global functions), we will 
define simulation as an equality of dynamics up to some local transformations. 

5.1 Transformations 

The transformations we consider are natural stochastic extensions of the transformation defined in J4j [5) 
for the classical deterministic CA. These transformations can be divided into two categories: trimming 
operations which allow to trim unwanted parts off the dynamics, and rescaling transformations which 
augment the set of states and/or the neighborhoods. 

5.1.1 Trimming operations 

They are based on three ingredients: 1) renaming states; 2) restricting to a stable subset of states; and 
3) merging compatible states. These ingredients are synthetized into two definitions (state renaming is 
implicit in both definitions). 

Definition 5. Let si = (Q,R,V,V' ,f) be a stochastic CA. 
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• ifi '• Q' — * Q is an injective function such that Y = (i(Q')) 1, is F-stable (i.e. F(Y,R Z ) C Y) then the 
/-restriction of si is the stochastic CA: 

i si = (Q',R,V,V', i f) 

where if is the local function associated with the explicit global function iF such that, Vc G I, 
Vs G R 1 , iF(c,s) = l~ l oF(I(c),s) where I : Q' 1, — > (J denotes the cell-by-cell extension ofi; 

• if 71 : Q' is surjective and F -compatible (s.t. YloF(c,s) = ITo F (c',s) for all sand all c,c' such 
that 11(c) = n(c'), where H : Q 1 — > Q' z is the cell-by-cell extension of n), then the 7T-projection 
of si is the stochastic CA: 

« £ / = (Q',R,Vy,«f) 

where n f is the local function associated with the explicit global function 71 F such that n F(c' \s) = 
IT o F(c, s) where c is any configuration in IT 1 (c ; ). 
If i : Q! — > Q and n : Q' — >■ Q" verify the required stability and compatibility conditions, we denote 
by f si the 7T-projection of the /-restriction of si ' . 

Definition 6. Let si\ = (Qi,Ri,Vi,V(,fi) and sii = {Qi^Ri^iy^ fi) be two arbitrary stochastic CA. 
We define the following relations: 
s 

• si\Q S&2, si\ is a stochastic subautomaton of sii, if there is some i-restriction of sij. such that 

S 

• si\ < s/2, si\ is a stochastic factor of ' sii, if there is some K-projection of si2 such that 5^p x = =5^/r 2 >' 

N N D D 

Similarly, we define C and < (for non-deterministic global maps) and C and < (for deterministic global 

D N S 

maps). We also define the three relations <C, <C and <Z using projections of restrictions. For instance: 
s 

s/\ <Zsiz if there are i and % such that 5^f x = =5^f 2 . 
5.1.2 Reseating transformations. 

The transformations defined so far only allow to derive a finite number of CA from a given CA (up to 
renaming of the states) and thus induce only a finite number of dynamics. In particular, the size of the set 
of states, and the size of the neighborhood, can only decrease. Following the approach taken for classical 
deterministic CA, we now consider rescaling transformations, which allow to increase the set of states, 
the neighborhood, etc. Rescaling transformations consist in: composing with a fixed translation, packing 
cells into fixed-size blocks, and iterating the rule a fixed number of times. Notice that since stochastic 
CA are composable, they are stable under rescaling operations, whereas PlainPCA are not. 

The translation (for k G Z) is the deterministic CA whose deterministic global function verifies: 

yc,Vz,@o k (c) z = c z+k . 

Given any finite set S and any m ^ 1, we define the bijective packing map bm'-S 1 — >■ (S m ) by 

bm{c)z = { c mzi c mz+li • • • , c mz+m-l) f° r ^11 C and Z- 

Definition 7. Let si = (Q,R,V,V',f) be any stochastic CA. Let m,t ^ 1 and k G Z. The rescaling of 
si with parameters (m,t,k) is the stochastic CA si^^i = (Q m ,(R m )' ,V + ,V[,f ( ~ m ' t ' k ' } ) whose explicit 
global function F^™'''^ is defined by: 

F^(c,s)=b m oa k oF t (b m \c),b m \s i ),...,b m \s t )) 

where s l ,...,s f G (R m ) Ij are the t components of s (s.t. s'j = (sj)i), and V+,V' + the modified neighbour- 
hoods following b m . 
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5.2 Simulation Pre-Orders 

We can now define the general simulation relations. 

Definition 8. For each local relation © among the nine relations of Definition^ we define the associated 
simulation relation =<; by 

si x 4^2^^mx } m 2 ,t\,hMM,^\ {mMM) © ^2 {m ' t2k) 

We therefore define nine simulation relations =4?, =4f, =4^., =4^, =4f, =4® and =^^, where the sub- 

script denotes the kind of local relation used (injection, Jtrojection or mixed) and the superscript denotes 
the kind of global functions which are compared (Stochastic, Non-deterministic or Deterministic). 

Lemma 1. A restriction (resp. projection) of a restriction (resp. projection) of some stochastic CA si is 
a restriction (resp. projection) of si . Moreover, any restriction of a projection of si is the projection of 
some restriction of si. 

Proof. This is a straightforward generalization of the corresponding result in the classical deterministic 
settings. A detailed proof for the deterministic case appears in Theorem 2.1 of 0. All arguments given 
in the proof are easily adaptable to our setting. □ 

The lemma above implies that any sequence of admissible restrictions and projections can be ex- 
pressed as the projection of some restriction. 

From Lemma [T] it follows that all local relations defined are transitive and reflexive. Moreover, 

D D 

the deterministic relations C and < are exactly the same as those defined in the classical setting of 
deterministic CA 

Fact 3. All simulation relations =4f, =4^, =4f n , ^.f, =4%, =4%, =4f, =4%, =^ are pre-orders. 

Proof. It is sufficient to verify that for any local comparison relation @: 

1. © is compatible with rescalings, i.e. 

si X ©si 2 ^ Sjy^fi ©Si 2 {m ^ k) 

2. rescalings are commutative with respect to ©, i.e. 

Both properties are straightforward from the definitions. Then, the transitivity of any simulation relation 
follows from the transitivity of the corresponding local comparison relation ©. □ 

Each stochastic pre-order is a refinement of the corresponding non-deterministic pre-order as shown 
by the following fact (straightforward corollary of Fact [2]). 

Fact 4. If si\ =4fs/2 then si\ si%. The same is true for pre-orders ^4%, =^~, and the corresponding 
( non- )deterministic pre-orders. 

Note that for any simulation relation si\ ^ si 2 means that two global functions are equal where 
one is obtained by applying only space-time-diagram-preserving rescaling transformations to si\ (the 
simulated CA) and the other is obtained by applying both rescaling transformations and trimming oper- 
ations to si 2 (the simulator). 
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5.3 Classifications of Stochastic Cellular Automata 

Simulation pre-orders can be seen as a tool to classify the behaviors of CA (4l|5l. They can be used to 
formalize in a more precise way the empirical classes defined historically through experimentations. We 
now give some results on the structure induced on stochastic CA by this classification. 

Ideals. Some classes of stochastic CA may only simulate CA of their own class. This is the case of the 
deterministic CA and also of the class of the noisy CA which are the CA F such that J/f(c) = Q 1, for 
aUc. 

Fact 5. Let =<! be any non-deterministic or stochastic pre-order. Let s/\ and s?2 be stochastic CA such 
that sf\ =<; s/j- Ifs/j is deterministic (resp. noisy) then s/\ is deterministic (resp. noisy). 

Proof. By Fact |4] it is sufficient to prove this for non-deterministic simulations. The property that the 
explicit global function is deterministic or noisy (i.e. surjective on each configuration) is preserved by 
rescaling transformation. Hence it is sufficient to check that being deterministic or noisy is preserved by 
restriction and projection. This is straightforward for projection (because a projection is an onto map). 
Determinism is clearly preserved by restriction. Moreover, a noisy stochastic CA does not admit any 
non-trivial restriction because no subset of states is stable under iteration. Hence, the restriction of a 
noisy CA is necessarily itself (up to renaming of states) or the trivial CA with only one state. Both are 
noisy and the fact follows. □ 

Simulation of stochastic CA by a PlainPCA. Even if some stochastic CA cannot be expressed as a 
PlainPCA (because of potential local random correlation), each can be simulated by a particular Plain- 
PCA. Each step is simulated by two steps: 1) each cell first copies its random symbol in its state so that 
2) its neighbors read in its state its random symbol to complete the transition. 

Theorem 3. For any stochastic CA a/ = (Q,R,V,V J A ) there is a PlainPCA 08 such that si '^38. 

Proof. The idea is to simulate one step of s/ by two steps of 38: 

1. generate a random symbol locally and copy it to a component of states; 

2. simulate a stochastic transition of sf reading states only and ignoring random symbols. 

Formally, let 38 = (Qb,R,V,V where Qb = QU Q x R and fg is any local function such that the 
associated explicit global function F# verifies: 

1. for any c £ Q z CQb and any s £ R z , (F B (c,s)) z = (c z ,s z ) 

2. for any c G (Q x R) z C gf and any s G R z , F B (c,s) = F a (kq(c) , 7i R (c)) where Kq and 7i R are cell- 
by-cell projections on Q and R respectively. 

s 

It is straightforward to check that sf C ^ with the restriction induced by the identity injection 

i : Q z -> Q z C Ql . □ 

Note that the restriction is essential in the above construction since the behavior is not specified (and 
no correct behavior can be specified) on configurations where states of type Q and states of type Qx R 
are mixed. In particular it is false that the stochastic CA is the square of the PlainPCA; it is a restriction 
of that. 

Still, one could think that we might achieve a simpler simulation by taking Qb = Q x R and doing 
the two steps simultaneously so that F B (c,s) would be the cell by cell product of Fa(tIq(c), Kr(c)) and 
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s. But this does not work: for such a SS there is generally no restriction nor projection nor combination 
of both able to reproduce the stochastic global function of srf. Indeed, if some c and s\,s% are such that 
Fa(c,s\) ytz Fa{c,S2) there is no valid way to define a corresponding configuration for c in Fb because the 
<2-component of states in Fb depends only on the previous deterministic configuration, not on the random 
configuration. Then, one might see this impossibility as an argument against our formalism of simulation. 
Of course, many extensions of our definitions might be considered to allow more simulations between 
stochastic CA. However, we think that the random component of the simulated CA should never be used 
to determine which deterministic configuration of the simulator CA corresponds to which deterministic 
configuration of the simulated CA. Doing so would be like predicting the noise of a system to prepare 
the state of another system. In particular, we do not see any reasonable formal setting where Fb defined 
as above would be able to simulate Fa- Fa and Fb might look like two syntactical variants of essentially 
the same object, but, as stochastic dynamical systems, they are very different. For instance, not every 
configuration can be reached from any configuration in Fb whereas Fa could have this property {i.e. be a 
noisy stochastic CA). 

We believe that a better understanding of the relationship between stochastic CA and Plain PC A 
should go through the following questions: is there a Plain PC A in any equivalence class induced by the 
pre-order =^f? is any stochastic CA ^-simulated by some PlainPCA? 

6 Universality 

The quest for universal CA is as old as the model itself. Intrinsic universality has also a long story as 
reported in fT31l . Our formalism of simulation allows to open the quest to stochastic cellular automata. 

Indeed, one of the main by-product of each simulation pre-order defined above is a notion of intrinsic 
universality. Formally, given some simulation pre-order =<I, a stochastic CA si is ^-universal if for any 
stochastic CA SB we have SB ^ srf . When considering deterministic pre-orders, we recover the notions 
of universality already studied in literature for classical deterministic CA |[T4l[T6l l5l. 

6.1 Negative results 

When considering non-deterministic or stochastic global functions, the random symbols are hidden. Still, 
the choice of the set of random symbols plays an important role in the global functions we can possibly 
obtain. We denote by yjin) the set of the prime factors of n. By extension, for a stochastic CA with 
set of random symbols R, we denote by < J>3'(£/) the set CP3~( |^| ) - We have the following result: 

Lemma 2. Let srf\ = (Q,R\,Vi,V{,fi) and s^i = (2,^2, Vi, V^fi) be two stochastic CA with same set 
of states. If they are not deterministic and S^p x = <9 ? p 2 then CP3"(j#i) n !P9~(j^2) ^ 0. 

Proof. If s4\ is not deterministic, then there must exist some configuration c G £? z and two configurations 
y y^y' such that {v,/} Q ^f, (c). So there are two disjoint cylinders [u] z n [u'] z = with y G [u] z and 
/ G [u'] z . Therefore < (^*f(c))([m] z ) < 1. Besides, by definition of S^p, we have 

(^ 1 (c))([»U=V 1 « Mz ) = f <1 

H 

for some relatively prime numbers p and q (recall that Vi is the uniform measure over Rf and that 
= { s eRf: Fi(c, s) G [u] z }). Moreover 73^{q) C y${\Ri\) = ^(M) since g\ [u] _ is a finite union 
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of cylinders and since the Vi -measure of any cylinder is a rational of the form for some integers 
a,b ^ 1. Now, by hypothesis, we have also 

{y F2 (c))([u) z ) = ^ 

and by a similar argument as above we deduce that CP3"(^) C yj^-i). The lemma follows since ^Jicf) / 
(because | < 1). □ 

From Lemma[2]it follows, surprisingly perhaps, that the random symbols of a stochastic CA limit its 
simulation power to stochastic CA that have compatible random symbols. 

Theorem 4. Let =^ be any stochastic simulation pre-order, and srf\ and s^2 two stochastic CA which are 
not deterministic. If 4 sf 2 then O^M) H ^(^2) i= 0- 

Proof. Trimming operations (restrictions and projections) do not modify the set of random symbols. 
Rescaling transformations modify the set of random symbols in the following way: R i-> R n for some 
integer n. Therefore such transformations preserve the set of prime factors 77 {si/) of the considered 
CA si/. Moreover, rescaling transformations do not affect determinism: the rescaled version of a CA 
which is not deterministic cannot be deterministic. Hence, the relation si/\ =<! si/% implies an equality of 
stochastic global functions of two CA which have the same prime factors as sf\ and si/2 and one of which 
is not deterministic. Therefore none of them is deterministic and the theorem follows from lemma|2] □ 

The consequence in terms of universality is immediate and breaks our hopes for a stochastic univer- 
sality construction. 

Corollary 1. Let =^ he any stochastic simulation pre-order. There is no ^-universal stochastic CA. 



6.2 Positive results 

Still, the negative result of Corollary [TJ leaves open the possibility of partial universality constructions. 
We will now describe how to construct a stochastic CA which is ^-universal (hence also ^-universal; 
however note that the existence of a or even of a ^-universal is still open), and then draw the 
consequences. 

Since we are not concerned with size optimization, we will use simple construction techniques using 
parallel Turing heads and table lookup as described for classical deterministic CA in |fl5l . More precisely, 
we construct a stochastic CA = {Qu,Ru,Vu,V{j,fu) able to ^-simulate any stochastic CA si/ = 
{Q,R, V, V ,f) with no rescaling transformation on £f and no shift in the rescaling of Therefore each 
cell of will be simulated by a block of m cells of and each step of srf will be simulated by t steps 
of it and m depend on srf and are to be determined later). 

The blocks of m cells have the following structure (the restriction in the pre-order handles the trimming 
of any invalid block): 



SYNC transition table Q-state /^-symbol g-states f neighbors /^-symbols of neighbors 



where each part uses a fixed alphabet (independent of Q and R) and only the width of each part may 
depend on stf '. To each such block is attached a Turing head which will repeat cyclically a sequence of 
4 steps (sub-routines) described below. On a complete configuration made of such blocks there will be 
infinitely many such heads (one per block) executing these steps in parallel. Execution is synchronized 
at the end of each step (SYNC part) and such that two Turing heads never collide. Precisely, for some 
steps (2 and 4) the moves of all heads are rigorously identical (hence synchronous and without head 
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collision). For some other steps (1 and 3), the sequence of moves of each head depend on the content of 
its corresponding block but these steps are always such that the head don't go outside the block (hence 
no risk of head collision) and they are synchronized at the end by the SYNC part which implements a 
small time countdown initialized to the maximum time needed to complete the step in the worst case. 
The parts holding /^-symbols are initially empty (uniformly equal to some symbol) for each block. The 
4 steps are as follows: 

1. generate a string representing a random /?-symbol in the /^-symbol part using (possibly several) 
random Rjj -symbols present in that part of the block; 

2. copy the /^-symbol part to the appropriate position in the /^-symbols of neighbors part of each 
neighboring block. Do the same for Q-state; 

3. using information about (Estates and /?-symbols in the block, find the corresponding entry in the 
transition table and update the Q- states part of the block accordingly; 

4. clean /^-symbol and /^-symbols of neighbors parts (i.e. write some uniform symbol everywhere). 

This construction scheme is very similar to the one used for classical deterministic CA but two points 
are important in our context: 

• step 4 is here to ensure that each configuration of si has a canonical corresponding configuration of 
% made of blocks where the parts holding /^-symbols is clean; (step 4 is required for the existence 
of the injection i) 

• depending on the way we generate strings representing a /^-symbols from strings of Rjj -symbols 
in step 1, we will obtain or not a uniform distribution over R (recall Theorem[4]). 

In the general case, we can always fix (by the means of the injection i) a width large enough for parts 
containing the /^-symbols so that all /?-symbols can be obtained (but with possibly different probabilities). 
We therefore obtain a universality result for non-deterministic simulations. 

Theorem 5. Let =^ be either or There exists a ^-universal CA. 

Note that this ^-universal CA is a PlainPCA, and we obtain thus a stronger version of the simulation 
mentioned in Section [53] page [219] 

Now, if we are in a case where CP3"(^/) C yj(U) then it is possible to choose a generation process 
in step 1 such that each /^-symbol is generated with the same probability. We therefore obtain an optimal 
partial universality construction for stochastic simulations. 

Theorem 6. Let =^ be either =^f or For any finite set P of prime numbers, there is a stochastic CA 
fy P such that for any stochastic CA si: "PJ(s/) CP=>i^ Moreover W P is a PlainPCA. 



7 Open Problems 

Intrinsic simulations has been proven to be a powerful tool to hierarchize behaviors in the deterministic 
world. In particular, the notion universal CA allows to formalize the concept of "most complex" CA 
as the ones concentrating "all the possible behaviors" within a given class 131|5l.The formalism and the 
notion of intrinsic simulation developed here for stochastic CA, enables us to export this classification 
tool to the stochastic world. In particular, it would be interesting to see whether our partial universality 
construction relates to experimentally observed classes, as in |fT91 . At the more theoretical level and 
amongst all the concrete questions raised by this article, the following ones are of particular interest: 

• Is there for any stochastic a PlainPCA S3 which is -equivalent to s/7 
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• Is there for any stochastic £f, a PlainPCA such that sf^ s n 381 

• Are there ^-universal cellular automata? 

• Are universal CA the same for pre-order and 

Our setting can also be generalized by taking any Bernouilli measure on the /^-component (instead 
of the uniform measure). We believe that positive and negative results about universality essentially still 
hold but under a different form. 

As noticed by an anonymous referee, there is an easy algorithm to decide whether to ID CA have the 
same non-deterministic global function. We are currently working on an adaptation to decide equality of 
global stochastic functions. 
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